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(54) Primitive edge pre-f iltering 

(57) A computer graphics system renders an image 
using forward texture mapping. Image pixels form a pix- 
el grid in a screen space. Objects of the image are mod- 
eled by primitives. A texture memory 1 34 stores a tex- 
ture map with texe Is forming a texel grid in a texture 
space. A rasterizer 1 20 determines for each primitive in 
the texture space associated texels that at least partly 
fall within the primitive and assigns texel attributes to 
those texels. A texel shader 130 transforms texel at- 



tributes to color attributes. A contribution filter 81 0 filters 
a continuous signal describing the primitive, yielding, 
when sampled for a given texel position, a respective 
contribution factor providing a measure of overlap of the 
corresponding texel with the primitive in texture space. 
A screen space resampler 140 resamples color at- 
tributes of the texels according to the pixel grid forming 
display pixel data using the contribution factor as a 
weight. 
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Description 



SUMMARY OF THE INVENTION 



FIELD OF THE INVENTION 

[0001] The invention relates to a computer graphics 
system and a method of computer graphics processing. 

BACKGROUND OF THE INVENTION 

[0002] An important element in rendering 3D graphics 
is texture mapping. Mapping textures onto surfaces of 
computer-generated objects is a technique which great- 
ly improves the realism of their appearance. The texture 
is typically a 2D picture, such as a photograph or com- 
puter generated image. For example, (part of) a 2D im- 
age of a wall may be projected on a 3D representation 
of a wall in a computer game. The term "texture" is used 
as a synonym for any image or structure to be mapped 
onto an object. The term "texel" (texture element)- is 
used to refer to a picture element (pixel) of the texture. 
In general, there are several methods known for map- 
ping the texture onto the screen grid. Most conventional 
computer graphics systems use a so-called inverse tex- 
ture mapping approach. In this approach, pixels of the 
screen are processed sequentially and for each pixel, 
during a rasterization process, a projection of the screen 
pixel on the texture (resulting in a projected pixel's "foot- 
print" in texture space) is determined and an average 
value which best approximates the correct pixel color is 
computed. This involves determining the texels that 
overlap with the projected pixel footprint. An alternative 
approach is the so-called forward texture mapping 
method. This method works by traversing texels in the 
coordinate system defined by the texture map (i.e. start- 
ing from the texture space). The texel colors are then 
splatted to the screen pixels, using resamplers com- 
monly used for video scaling. This resampling may in- 
clude a reconstruction in texture space, a mapping from 
texture space to screen space, and pre-filtering and 
sampling in screen space. The contribution of a texel is 
then splat to (i.e. distributed over) pixels of which the 
pre-filter footprint overlaps with the reconstruction filter 
footprint of the texel. 

[0003] A 2D or 3D object to be rendered is typically 
modeled using primitives (usually triangles). A vertex 
shader of the graphics system receives the vertices of 
a primitive as input and uses a vertex shading program 
to change or add attributes for each of these vertices. A 
rasterizer accepts vertex coordinates which define ver- 
tices of the primitives. In a forward mapping system, the 
rasterizer traverses the primitive in texture space while 
interpolating these attributes. For each grid position {u, 
v) of the texture visited during traversal, a texel shader 
calculates from these attributes the local color of the sur- 
face of the primitive. These surface colors are then 
mapped and resampled to screen pixel locations by the 
screen space resampler. 



[0004] It is an object of the invention to provide a com- 
puter graphics system able to provide a higher quality 

5 forward texture mapping. 

[0005] To meet the object of the invention, a computer 
graphics system for rendering an image for display us- 
ing forward texture mapping, pixels of the image being 
specified according to a predetermined pixel grid in a 

10 screen space; the image including at least one object 
modeled by primitives; includes: 

a texture memory for storing at least one texture 
map; texels of a texture map being specified ac- 
15 cording to a predetermined texe| grid in a texture 
space; 

a rasterizer operative to, for each primitive in the 
texture space, determine associated texels that at 
least partly fall within the primitive and to assign tex- 

20 el attributes to the associated texels; 

a contribution filter (81 0) operative to, for each prim- 
itive in the texture space, filter a continuous signal 
describing the primitive, yielding, when sampled for 
a given texel position, a respective contribution fac- 

25 tor providing a measure of overlap of the corre- 
sponding texel with the primitive in texture space; 
a texel shader (130) operative to, for each primitive 
in the texture space, transform texel attributes of the 
associated texels to color attributes of the texels; . 

30 and 

a screen space resampler (140) operative to resa- 
mple color attributes of the texels according to the 
predetermined pixel grid forming pixel data for the 
display using the contribution factor as a weight. 

35 

[0006] The inventor has realized that the quality of the 
graphics system can be improved by performing a filter- 
ing step in texture space, in addition to the resampling 
in screen space. By filtering a continuous signal that de- 

40 scribes the primitive, before sampling it for a visited texel 
location, a contribution factor is assigned that depends 
on a measure of overlap of the texel with the primitive 
in texture space. For a polygon, the continuous signal 
represents being inside or outside the primitive, typically 

45 specified by the primitive's edges using its vertices. In 
the prior art forward texture mapping systems, texels 
were ignored it they were outside the primitive, even 
though the footprint of the texel partly overlapped the 
boundary of the primitive. The system according to the 

50 invention achieves a higher quality rendering, in partic- 
ular for narrow objects where the prior art mechanism 
resulted in stronger aliasing effects. The primitive may, 
in principle, be any suitable shape. Commonly used 
shapes are polygons, in particular triangles. 

55 [0007] According to the measure of the dependent 
claim 2, the contribution factor depends on a percentage 
of area overlap of a texel footprint in the texel grid with 
the primitive. This can be seen as using a box filter for 
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filtering the primitive boundary signal. 
[0008] In a preferred embodiment, according to the 
measure of the dependent claim 3, the area overlap is 
determined analytically. This gives an accurate result of 
the percentage of area overlap. 

[0009] According to the measure of the dependent 
claim 4, the analytic determination includes determin- 
ing, for a texel footprint that is not is fully outside or inside 
a primitive, intersection points between a boundary of 
the primitive and a boundary of thetexel footprint. Know- 
ing the intersection points, in particular for polygons, 
makes it simple to determine the percentage of overlap. 
[0010] According to the measure of the dependent 
claim 5, boundary equations for the boundary of the 
primitive are pre-calculated. This enables a fast deter- 
mination of the intersection point of the primitive bound- 
ary with the texei footprints. 

[0011] To meet an object of the invention, a method 
of rendering an image for display using forward texture 
mapping, pixels of the image being specified according 
to a predetermined pixel grid in a screen space; the im- 
age including at least one object modeled by primitives; 
the method including: 

storing at least one texture map; texels of a texture 
map being specified according to a predetermined 
texel grid in a texture space; 
for each primitive in the texture space, determining 
associated texels that at least partly fall within the 
primitive and to assign texel attributes to the asso- 
ciated texels; filtering a continuous signal describ- 
ing the primitive, yielding, when sampled for a given 
texel position, a respective contribution factor pro- 
viding a measure of overlap of the corresponding 
texel with the primitive in texture space; and trans- 
forming texel attributes of the associated texels to 
color attributes of the texels; and 
resampling color attributes of the texels according 
to the predetermined pixel grid forming pixel data 
for the display using the contribution factor as a 
weight. 

[0012] These and other aspects of the invention are 
apparent from and will be elucidated with reference to 
the embodiments described hereinafter. 

Brief description of the drawings 

[0013] In the drawings: 

Fig. 1 shows a graphics pipeline in which the inven- 
tion may be used; 

Fig.2 shows a 4D mipmap structure; 

Fig.3 illustrates reconstruction filtering; 

Fig.4 illustrates screen space pre-filtering; 

Fig.5 shows the texture pre-filtering according to the 

invention; 

Fig. 6 illustrates area pre-filtering; 



Fig. 7 provides a further example of area pre-filter- 
ing; 

Fig. 8 shows the contribution filter according to the 
invention in the form of an area pre-f liter; 
5 Figs. 9 and 10 compares the outcome of a system 

without and with texture space area pre-filtering; 
Fig. 11 illustrates improvements achieved for adja- 
cent triangles; and 

Fig. 12 illustrates the indention in the form of an im- 
10 proved texture space reconstruction filter; 

Fig. 13 illustrates this for a 2D representation of the 
reconstruction filter footprint; and 
Fig. 1 4 shows a block diagram of a computer incor- 
porating the graphics system according to the in- 
*5 vention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT . 

20 [0014] Fig.1 shows an exemplary architecture of the 
last stages of a graphics pipeline in which the invention 
may be utilized. In this description it is assumed that the 
models to be visualized are described using triangles as 
primitives. Persons skilled in the art can easily apply the 

25 same techniques to other primitives, such as other pol- 
ygons or quads or curved surfaces such as Bezier 
patches. Input to the pipeline are primitives specified by 
its vertices by a graphics program, such as a computer 
game, and the earlier stages of the graphics pipeline. 

30 The primitives are given in the screen space, using (x, 
y) coordinates as well as the respective texet space, us- 
ing (u, v) coordinates. The pipeline includes a vertex 
shader 110, texture space rasterizer 120, texel shader 
130 with a texture space resampler 132 and texture 

35 memory 134, a screen space resampler 140 and an 
Edge Anti-Aliasing and Hidden Surface Removal (EAA 
& HSR) unit 150. The outputted pixels are stored in a 
frame buffer 160 for display, for example using a D/A 
converter, such as a RAM DAC, to generate analogue 

40 output. If so desired also a digital interface, such as DVI, 
may be used to supply the pixel data to a display. The 
display may be of any type, including CRT, LCD, plasma 
display. Alternatively, the rendered picture may also be 
used as a texture map for subsequent primitives. The 

45 functions of the graphics pipeline shown in Fig.1 will now 
be described in more detail to illustrate an exemplary 
system in which the invention may be used. 
[0015] The vertex shader 110 receives the vertices of 
a triangle (primitive) as input and uses a vertex shading 

50 program to change or add attributes for each of these 
vertices. The data provided by the vertex shader usually 
includes attributes like diffuse and/or specular colour, 
texture coordinates, (homogeneous) screen coordi- 
nates, and sometimes extra data like surface normals 

55 or other data required for the shading process. The ver- 
tex shader may be a traditional Transform and Lighting 
unit. The attributes generated by the vertex shader are 
offered to a rasterizer. 
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[0016] The rasterizer 120 traditionally operated in 
screen space. Such a rasterizer used a scanline algo- 
rithm to traverse the pixels which lie within the projection 
of the primitive on the screen, by selecting the screen 
coordinates from the vertex attributes as driving varia- 
bles for the rasterization process. In the forward texture 
mapping system in which the invention is used, the ras- 
terizer operates in surface space. The surface space 
rasterizer traverses a parameterization of the surface of 
the primitive (rather than the projection on the screen), 
by selecting, for example, the texture coordinates (in- 
stead of screen coordinates) as the driving variables for 
the rasterization process. The rasterizer traverses the 
primitive over a "surface grid". The grid associated with 
a texture map provides such a surface grid, and is pref- 
erably used as surface grid (since obtaining texture 
samples on a texture grid does not require resampling). 
In absence of texture maps, or when for example tex- 
tures are 1 D or 3D, another grid may be chosen. As the 
coordinates in the texture space are used u (for the 'hor- 
izontal' direction) and v (for the 'vertical' direction). It will 
be appreciated that 'horizontal' and Vertical' are in this 
description only relative. For example, the screen may 
be rotated, leaving the graphics processing unaffected 
but rotating the output on the screen. Since the texture 
grid is often used as the surface grid, the notation "tex- 
ture grid" (and "texture space" and "texel") will be used 
to denote such generalized grids (and associated spac- 
es and samples). As the rasterizer traverses the texel 
positions of the grid, all attributes that were given at each 
vertex are interpolated over the grid (typically linearly, 
except for the screen coordinates to which a texel is pro- 
jected, which are interpolated perspectively). The at- 
tributes are then available at each texel location, where 
the texel shader 130 can use them. While traversing the 
u and v texture coordinates of the base grid, the raster- 
izer also maintains the corresponding screen coordi- 
nates (x, j/), where x represents the horizontal pixel po- 
sition and y represents the vertical pixel position. The 
correspondence can be maintained by linear interpola- 
tion of x , y and w, where the A denotes homogeneous 
coordinates. Such coordinates are well-known in the art 
and will not be described any further here. Screen co- 
ordinates cap then be calculated using the perspective 
division x = and y = The w w screen y coordinate 
is only used for mi pmap^ietermi nation purposes, as will 
be explained in more detail below. For computing the 
actual colors, the rasterizer may interpolate diffuse.color 
(RGBA), specular color (RGB) and extra texture coordi- 
nate pairs (allowing for multi-texturing). Also other at- 
tributes (such as a surface normal) may be interpolated. 
[0017] Preferably, the texture space rasterizer 
traverses the texture map on a grid corresponding to 4D 
mipmapping, as illustrated in Fig.2. Using mipmapping, 
in a preprocessing step several downscaled versions of 
the original texture (2D picture) are created. During tex- 
ture mapping, the part of only the smaller downscaled 
picture which matches best in resolution with the screen 



image is read and mapped to the screen. The original 
2D picture along with its downscaled versions is called 
a mipmap. Texture mapping as well as mipmaps are par- 
ticularly described in "Survey of Texture Mapping Paul 
s S. Heckbert, IEEE Computer Graphics and Applica- 
tions, Nov. 1986, pp. 56-67 and in U.S. 6,236,405 B1 . 
In a mipmap, the original image is denoted as level 0. 
In level 1 , each entry holds an averaged value of, for 
example, 2x2 texels. As used herein the term "texel" 
10 (texture element) refers to a picture element (pixel) of 
the texture. This can be continued until the top-level is 
reached, which has only one entry holding the average 
color of the entire texture. Thus, in a square mipmap 
where subsequent levels are scaled using a factor of 
15 two in each direction, level n has one fourth the size of 
level n-1 . Other scaling factors may be used as well. 
Several types of mipmaps are known, varying in which 
downscaled images are stored. In a 3D mipmap, both 
directions are downscaled by the same factors, while in 
20 a 4D mipmap the original image is downscaled inde- 
pendently in both dimensions. Compared to the 3D mi- 
pmap, the 4D mipmap arrangement requires a lot of 
memory to store. Computer graphics programs, such as 
games, therefore, often use the 3D mipmap structure. 
2s An earlier application IB02/05468 of the applicant, and 
sharing an inventor with the present application de- 
scribes a method for generating a 4D mipmap on the fly 
from a 3D mipmap. This enables high quality rendering 
also in combination with programs that do not supply a 
30 4D mipmap to the graphics system. A 3D mipmap is 
specified by the mipmap level. A 4D mipmap is specified 
by a horizontal mipmap level mml u and a vertical mip- 
map level mmlyj. Fig.2 shows a 4D mipmap giving details 
of 16 mipmaps (0,0), (1,0), (3,3). The mipmaps indi- 
35 cated in gray (0,0), (1 ,1), (2,2), and (3,3) form the orig- 
inal 3D mipmap levels 0, 1,2, and 3, respectively. The 
rasterizer supplies the 4D mipmap levels (mml u , mml v ). 
[001 8] The texel shader 1 30 computes for each texel 
the local surface color. The texel shader operates on the 
40 attributes on grid positions in the surface grid and if there 
are any secondary textures associated with the primi- 
tive, it uses inverse mapping with standard texture 
space resamplers to obtain colors from these. When 
texture data is needed, the texture space resampler is 
45 used to obtain a texture sample given the texture coor- 
dinates. These texture coordinates are generated by the 
texel shader based on the interpolated coordinates re- 
. ceived from the rasterizer and any results from previous 
texture fetches (so-called dependent texturing) and/or 
50 calculations. The texture filter operation is usually based 
on bilinear or tri-linear interpolation of nearby texels, or 
combinations of such texture probes to approximate an 
anisotropic (perspectively transformed) filter footprint. 
The 2D resampling operations of the texel space resa- 
55 mpler can efficiently be executed in two 1D resample 
passes using 1D FIR filter structures. In a situation 
where the 4D mipmap is constructed on the fly, a texture 
fetch then amounts to 4D mipmap reconstruction from 
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the 3D mipmap data stored in the texture memory 134. 
In the example of Fig.2, the 4D mipmap (3,0) is recon- 
structed through downsampling of the 3D mipmap level 
0. A fetched texel can be combined with interpolated dif- 
fuse and/or specular color resulting in a color sample of 
the surface with associated (generally non-integer) 
screen coordinates which indicate where this texture 
sample is mapped to on screen. 

[0019] The screen space resamp/er 140 spfats 
mapped texels to integer screen positions, providing the 
image of the primitive on the screen. The screen space 
resampling includes the following operations: 

Reconstructing the color information in the texel 
grid to a continuous signal, 

Mapping the continuous signal from the texture 
space to the screen space, 

Pre-filteririg the mapped continuous signal in 
screen space, and 

Sampling the pre-filtered signal in screen space. 

[0020] Fig. ; 3 illustrates the reconstruction filtering us- 
ing a box as the footprint of the reconstruction filter. Oth- 
er filters, such as higher order filters may also be used. 
The figure shows a grid of texels. Each texel is shown 
as a rectangle representing the image surface covered 
by the pixel. The footprints of the original texels are tak- 
en and projected onto the screen. This does not only 
change the position but also the size of these input foot- 
prints. The size and location of an exemplary transfor- 
mation are shown as the rectangles with dashed lines 
in Fig.3. The solid dots illustrate the location the dimen- 
sionless input texel coordinate (typically coinciding with 
the middle of the input texel footprint) after the transfor- 
mation. As part of the transformation, the size of the box 
in the texel output domain is computed. During the re- 
construction filtering, input texels that appear to be oc- 
cluded during the terrain traversal may be dropped and 
not reconstructed. Also a more refined reconstruction 
may be used, particularly a contribution proportional to 
the non-occluded part of the first order reconstructed 
texel of the image. Fig.3 shows the result of the box re- 
construction and occlusion handling. The size of the 
boxes is a measure for the contribution of the original 
texel. For example, the reconstructed footprint of input 
texel 320 (i.e. the footprint after transformation) is indi- 
cated by the segment 340. In this example, the recon- 
structed footprint is approximately 75% of the footprint 
of the output texels. In this case, the contribution of input 
texel to the output image is set to a factor of 0.75. The 
reconstructed mapped footprint of input texel 330 falls 
partly in output texel 310 and partly in the output texel 
to the right of 310. The reconstructed footprint of input 
texel 330 is roughly 25% of the footprint of output texel 
31 0 and roughly 75% of the footprint of the neighboring 
output texel. The total contribution of input texel 330 is 
then 25% +75%. As illustrated in Fig.4, next, each out- 
put texel is then splat to (i.e. distributed over) pixels in 



the screen space of which the pre-filter footprint in 
screen space overlaps with the reconstructed box in the 
screen space (i.e. after mapping the texel to screen 
space). The reconstructed box of pixel 400 is shown with 
5 the highlighted rectangle 410. The pre-filter footprint 
may extend over several pixels. The filter may extend 
only horizontally, but may also have a vertical extent. In 
the example of Fig.4, a filter is used that with both a hor- 
izontal and vertical extent of three pixels, centered on 
10 the pixel to which it belongs and covering two neighbor- 
ing pixels. In this case, twelve output pixels receive a 
contribution. For each of those output pixels the contri- 
bution is determined by using the shape of their respec- 
tive pre-filter to weigh the input pixel value. 
15 [0021] The pixel fragments coming from the screen 
space resampler are then combined in the Edge Anti- 
Aliasing and Hidden Surface Removal (EAA & HSR) unit 
150, which uses a fragment buffers 160. Pixel fragments 
are depth-sorted into this buffer to solve the hidden sur- 

20 face problem. After all primitives have been rendered, 
all visible fragments for each pixel are combined (which 
mostly amounts to simple summation since the screen 
space resampler delivers colors already weighted by the 
pre-filter) and sent to the frame buffer. Edge anti-aliasing 

25 results from combining the partial contributions gener- 
ated by the screen space rasterizer near the edges, re- 
sulting in a final pixel color which can be a combination 
of colors from different primitives. 
[0022] The pipeline as shown in Fig. 1 features two 

30 resampling stages: the texture space resampler 132 
controlled via the shader, and the screen space resam- 
pler 140 for performing the resampling to the display 
grid. Texture mapping can be seen as a resampling 
process from texture samples (texels) to screen sam- 

35 pies (pixels). High quality texture and edge anti-aliasing 
can be achieved by use of screen space pre-f iltering be- 
fore the sampling process which is the last step of resa- 
mpling. However, more sampling than just texture (re) 
sampling is performed when rasterizing a primitive. The 

40 rasterizer itself samples the triangle when determining 
which rasterization grid positions should be visited. This 
sampling process can also lead to aliasing. This can be 
reduced by using an additional pre-filter, now operating 
in texel space, to avoid artefacts. The rasterization proe- 
ms ess for triangles has two inputs: a texture signal in the 
form of a discrete texture map, and a triangle signal in 
the form of the three vertices which describe a continu- 
ous triangle signal. Conventionally, this signal, say with 
value 1 within the triangle and 0 outside, acts as a kind 

50 of a discrete contribution signal, which determines that 
texture information outside the triangle should not, and 
texture information inside the triangle should fully con- 
tribute. During the conventional rasterization process 
this signal is sampled, by exactly visiting those grid po- 

55 sitions where the triangle signal is 1. For such a grid 
position the texel color is taken to contribute fully. This 
results in aliasing. According to the invention, it is as- 
sured that texels near the edge (in and outside the tri- 
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angle) only contribute partially. This can be accom- 
plished by pre-filtering the continuous contribution sig- 
nal, to obtain contribution values between 0 and 1 near 
the edges. This pre-filtering process will first be de- 
scribed in more detail below. Alternatively, the filtering s 
can be seen as a better form of reconstruction filtering 
in the resampling process from texture space to screen 
space. This view is presented following the description 
of the texture space pre-filtering. 

10 

Texture space pre-filtering 

[0023] When using forward texture mapping, a texture 
space rasterizer is used. The triangle signal is consid- 
ered in texture space and pre-filtered to avoid texture- *5 
space edge aliasing. This is depicted in Fig.5. Without 
pre-filtering, each texel in the input texture is either 
mapped to screen space (if its position lies within the 
triangle), or not. So either a texel fully contributes or not 
at, all. The subsequent resampling process will use the 20 
sample to reconstruct a continuous signal in the neigh- 
borhood of the sample using a box filter. If part of that 
area was not inside the triangle, the texel contributes 
too much, and a texel might not contribute enough if the 
texel lies just outside the triangle, but the reconstructed 25 
signal still has overlap with the triangle. Pre-filtering the 
triangle helps to correct this. In principle any suitable 
filter may be used. Using a box filter, the pre-filter can 
be seen as area reconstruction. Other suitable filters in- 
clude the tent filter, the cubic b-spline filter, etc. The area 30 
filtering, using a box filter, is depicted in Fig.6. In Fig.6A, 
a sample grid is shown with a triangle. In Fig.6B, this 
signal is sampled (with black dots indicating full contri- 
bution, and white dots indicating no contribution), re- 
flecting the prior art point sampling done by the texture 35 
space rasterization/resampling. In Fig.6C, the triangle 
is shown again with the pre-filter footprint areas associ- 
ated with the box filter marked in dashed lines. Fig.6D 
shows the contribution (as the gray level of the dots) in 
correspondence to the amount of overlap between the 40 
triangle and the filter footprint for each texel. This 
amounts to box pre-filtering of the triangle signal, where 
the percentage of area overlap between the texel foot- 
print and the triangle is used to determine the initial con- 
tribution for a texel (which is used in the subsequent re- 45 
sampling process). Fig. 7 shows a further example. Fig. 
7A shows a boundary of the triangle intersecting the box 
footprints of texels. Fig.7B shows the resulting contribu- 
tion factors indicated using gray levels. 
[0024] In a preferred embodiment as shown in Fig. 8, 50 
the area pre-filtering 81 0 is performed right after the tex- 
el shader 1 30, when the color for the current position of 
the rasterizer grid is known (the area calculation could 
be performed in parallel with the shading calculations if 
need be). This color is sent to the screen space resam- 55 
pier, which also accepts a contribution value. Tradition- 
ally, this contribution factor is one. With the area pre- 
filtering method, the area coverage fraction is used as 



contribution input to the resampler. The area pre-filtering 
then boils down to calculating the fraction of the rectan- 
gular filter footprint of the texel which is covered by the 
triangle. The area fraction may be determined in any 
suitable way. For example, an approximating approach 
may be used where the area fraction is calculated using 
super-sampling where the footprint is sampled using 
point-in-triangle tests to see if such a sample is within 
or outside the triangle, and computing the fraction of 
samples that are inside. Alternatively, the fraction may 
be determined analytically. For triangles, tests showed 
that the analytical approach was more efficient. Using 
the analytical approach, first a check may be performed 
to see if the filter footprint completely lies within the tri- 
angle (this is an often occurring case when the texel 
footprint lies in the triangle interior, far from any edge). 
If this is the case, the area fraction is one. If not, a check 
is performed on the further special case where the tri- 
angle is completely contained within the footprint. In this 
case, the area fraction can be calculated as the ratio 
between the triangle area and the footprint area. If nei- 
ther of these two special) cases applies, the intersection 
points between the triangle edges and the footprint edg- 
es are calculated, and the area of the thereby construct- 
ed polygon is used to calculate the area fraction. Deter- 
mining intersection points of triangles and box footprints 
falls well within the skills of a person skilled In the art. It 
should be noted that the rasterizer will normally not visit 
texels with no overlap with the triangle. If a simplified 
rasterizer might visit such texels, a fraction of 0 should 
be generated 

[0025] In order to accelerate the point containment 
and intersection calculations, it is preferred to pre-cal- 
culate the (texture space) edge equations for the trian- 
gle once per triangle as part of the triangle setup. The 
area coverage fraction is the ratio of the footprint area 
within the triangle and the total footprint area. The latter 
only depends on the current mipmap level and can 
therefore be initialized once, and need only be updated 
when a mipmap level switch occurs. 
[0026] The pre-filtering particularly helps with dealing 
with small triangles, which might otherwise be missed, 
or contribute too much, and lead to a staircase recon- 
struction of the triangle signal in the first step of the re- 
sampling process to screen. This effect is illustrated in 
Fig. 9. Fig.9A shows two thin triangles as spikes sticking 
up from a larger basis. The figure depicts the contribu- 
tion of each texel as the grey level. As shown in Fig.9A, 
without pre-filtering, the spikes appear blocky because 
texels either contribute fully or not at all. With triangle 
pre-filtering, the intensity fall-off going up the spike sug- 
gests the narrowing of the triangles, as is shown in Fig. 
9B. Similar objects are shown in Figure 10, after addition 
of texture color (where the contribution is used as 
weight) and projection to the screen. Fig. 1 0A shows the 
outcome without pre-filtering; Fig. 1 0B with pre-filtering. 
Note that even without triangle pre-filtering, high fre- 
quencies are removed from the final images by the 
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screen space resampler. But the aliasing artefacts that 
show as blocky shapes resulting from bad triangle signal 
sampling can not be removed by these filters. Also, 
since texture coordinates usually remain fixed for ob- 
jects, any reconstruction (and triangle signal sampling) 
is consistent over subsequent frames. In inverse map- 
ping, small triangles might cause flickering, because 
they are missed in one frame, and not in the next. This 
does not happen when pre-f iltering and sampling the tri- 
angle signal in texture space are applied. So, the ap- 
pearance of silhouette edges really benefits from trian- 
gle pre-filtering, 

[0027] A problem with texture space rasterization is 
that the contributions of adjacent triangles might not 
complement each other exactly for pixels near a triangle 
edge. This can occur when the triangles are rasterized 
on different grids, or even just at different resolutions of 
the same grid, as is the case when a different mipmap 
level is chosen. This is shown in Fig. 11 (the figure 
shows the box- reconstructed signal used in the resam- 
pling process to screen). Fig.11A shows two adjacent 
primitives. On the left, the two triangles are shifted apart 
somewhat to show the reconstructed edges more clear- 
ly, on the right they are shown side by side to show the 
sum of the contributions. Since both triangles are sam- 
pled on the same grid, they complement each other ex- 
actly. Fig.1 1 B shows the same situation, but with the up- 
per left triangle rendered at a higher mipmap level. 
Holes and overlap are present in the combined signal. 
When using area pre-filtering on the triangle signal (as 
shown in Fig. 11 C) the triangle problem is alleviated to 
a certain extent: the maximum amplitude of the error in 
this example has been halved. There is still some error 
left due to the box reconstruction of the texels: the box 
reconstruction in the coarser mipmap level distributes 
the contribution equally over an area corresponding to 
four areas in the finer level. These four areas are not 
enforced to have the same contribution value, so the 
sum of both will not be constant. But the error is smaller 
because the contribution nearthe edges is less depend- 
ent on the sample positions at which the rasterizer sam- 
ples, and more on the actual underlying continuous tri- 
angle signal which is consistently complementary for 
adjacent triangles. 

Improved reconstruction filter 

[0028] Above, the system according to the invention 
has been described as a pre-filtering process on the tri- 
angle signal. The system can also be seen as having 
an improved reconstruction process part of the resam- 
pling shown as item 140 in Fig.1 . This explanation is also 
included here to provide additional insight into how the 
exact convolution is approximated. Combining a texture 
sample with the triangle signal can be seen as the start 
of the reconstruction process which reconstructs the 
texture signal before it Is mapped to the screen. To ex- 
plain what happens, the resampling process is depicted 



in Fig. 12 for the one-dimensional case. Figs.12A to D 
show the resampling process where the triangle edge 
is not taken into account. Fig. 12A shows a texel near a 
triangle edge. A box filter {Fig. 12B) is used to recon- 

s struct a continuous signal. This reconstructed signal is 
then mapped to screen space (Fig. 1 2C), where it should 
be convolved with the p re-filter function. The area of the 
result (Fig.1 2D) is the weight for the texel that deter- 
mines its contribution to the pixel. Figs.12E to H shows 

10 the same process taking the triangle edge into account, 
resulting in a smaller weight for the edge texel. The re- 
sampling process of Fig.5 weighs a texel according to 
the calculation depicted in Fig. 6, resulting in the weight 
depicted in Fig.6D. This weight is then multiplied by the 

15 area coverage fraction. The result is an approximation 
of the weight depicted in Figure 12H. For the example 
in Fig. 12 this provides an overall weight that is a slightly 
too low approximation for this triangle (but slightly too 
high for any adjacent triangle to the left of this triangle). 

20 By simply multiplying with the area fraction, the spatial 
weight distribution of the pre-f ilter segment is effectively 
assumed to be constant. 

[0029] For 2D texture maps with 2D surfaces, the 
same principle holds. Fig. 13 depicts the mapped recon- 

25 struction footprint 131 0 of a texel in screen space, with 
above it, the segment 1320 of the pre-filter for a certain 
texel. This is the 2D variant of Fig. 1 2C. Only the volume 
under this pre-filter segment which lies above the trian- 
gle should betaken into account. This is the dark volume 

30 1330, similar to the area in Figure 12H. Instead of ex- 
actly calculating this volume, the area weighting of the 
texel in texture space (before the resampling process) 
approximates this volume by taking the total volume un- 
der the whole pre-filter segment (as is normally calcu- 

35 lated by the resampling process), and multiplying that 
by the fraction 1 240 of the area covered by the triangle 
in texture space (which under a general perspective 
mapping is not the same as the area fraction in screen 
space). An alternative way to look at Fig. 13 is to con- 

40 sider it in texture space. Then the reconstruction filter 
footprint is the rectangularfootprint in texture space, and 
the pre-filter segment is a mapped (from screen to tex- 
ture space) segment. 

[0030] Fig. 14 shows a blocks diagram of a computer 
45 1 400, including a central processing unit 141 0, a mem- 
ory 1420, a display 1430, and a computer graphics sys- 
tem 1 440 according to the invention. The computer may 
be a conventional computer, such as a personal com- 
puter, or workstation. The computer graphics system 
so may be implemented using a graphics processor. Such 
a graphics processor may be operated under control of 
a program causing the graphics processor to execute 
the method according to the invention. The program 
may be fixedly embedded (e.g. in ROM), but may also 
55 be loaded from a background memory. In the latter case, 
the program may be distributed in any suitable for, e.g. 
using a record carrier, such as a CD-ROM, or wired or 
wireless communication means, such as Internet. 
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[0031] It should be noted that the above-mentioned 
embodiments illustrate rather than limit the invention, 
and that those skilled in the art will be able to design 
many alternative embodiments without departing from 
the scope of the appended claims. In the claims, any 5 
reference signs placed between parentheses shall not 
be construed as limiting the claim. Use of the verb "com- 
prise" and its conjugations does not exclude the pres- 
ence of elements or steps other than those stated in a 
claim. The article "a" or "an" preceding an element does 10 
not exclude the presence of a plurality of such elements. 
The invention may be implemented by means of hard- 
ware comprising several distinct elements, and by 
means of a suitably programmed computer. In the de- 
vice claim enumerating several means, several of these 1$ 
means may be embodied by one and the same item of 
hardware. The mere fact that certain measures are re- 
cited in mutually different dependent claims does not inr 
dicate that a combination of these measures cannot be 
used to advantage. 20 



Claims - ;. 

1 . A computer graphics system for rendering an image 25 
for display using forward texture mapping, pixels of 
the image being specified according to a predeter- 
mined pixel grid in a screen space; the image in- 
cluding at least one object modeled by primitives; 

the system including: 30 

a texture memory (1 34) for storing at least one 
texture map; texels of a texture map being 
specified according to a predetermined texel 
grid in a texture space; 35 
a rasterizer (120) operative to, for each primi- 
tive in the texture space, determine associated 
texels that at least partly fall within the primitive 
and to assign texel attributes to the associated 
texels; *o 
a contribution filter (810) operative to, for each 
primitive in the texture space, filter a continuous 
signal describing the primitive, yielding, when 
sampled for a given texel position, a respective 
contribution factor providing a measure of over- 45 
lap of the corresponding texel with the primitive 
in texture space; 

a texel shader (130) operative. to, for each prim- 
itive in the texture space, transform texel at- 
tributes of the associated texels to color at- so 
tributes of the texels; and 
a screen space resampler (1 40) operative to re- 
sample color attributes of the texels according 
to the predetermined pixel grid forming pixel da- 
ta for the display using the contribution factor ss 
as a weight. 

2. A computer graphics system as claimed in claim ,1 , 



wherein the contribution filter is an area filter, where 
the contribution factor depends on a percentage of 
area overlap of a texel footprint in the texel grid with 
the primitive. 

3. A computer graphics system as claimed in claim 2, 
wherein in the area filter is operative to analytically 
determine the area overlap. 

4. A computer graphics system as claimed in claim 3, 
where the analytic determination includes deter- 
mining, for a texel footprint that is not is fully outside 
or inside a primitive, intersection points between a 
boundary of the primitive and a boundary of the tex- 
el footprint. 

5. A computer graphics system as claimed in claim 4, 
including pre-calculation boundary equations for 
the boundary of the primitive and applying the 
boundary equations to each of the texel footprint 
that is not is fully outside or inside the primitive. 

6. A computer including a central processing unit, a 
memory, a display, and a computer graphics system 
as claimed in claim 1 . 

7. A method of rendering an image for display using 
forward texture mapping, pixels of the image being 
specified according to a predetermined pixel grid in - 
a screen space; the image including at least one 
object modeled by primitives; the method including: 

storing at least one texture map; texels of a tex- 
ture map being specified according to a prede- 
termined texel grid in a texture space; 
for each primitive in the texture space: 

determining associated texels that at least part- 
ly fall within the primitive and to assign texel at- 
tributes to the associated texels; 
filtering a continuous signal describing the 
primitive, yielding, when sampled for a given 
texel position, a respective contribution factor 
providing a measure of overlap of the corre- 
sponding texel with the primitive in texture 
space; and 

transforming texel attributes of the associated 
texels to color attributes of the texels; and . 
resampling color attributes of the texels accord- 
ing to the predetermined pixel grid forming pixel 
data for the display using the contribution factor 
as a weight. 

8. A computer program operative to cause a processor 
to perform the method of claim 7. 
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